3D motion capture data: motion analysis and mapping to music
نویسندگان
چکیده
We report research performed on gesture analysis and mapping to music. Various movements were recorded using 3D optical motion capture. Using this system, we produced animations from movements/dance, and generate in parallel the soundtrack from the dancer's movements. Prior to the actual sound mapping process, we performed various motion analyses. We present here two methods, both independent of specific orientation or location of the subject. The first deals with gestural segmentation, while the second uses pattern recognition.
منابع مشابه
Mapping sound to human gesture: demos from video-based motion capture systems
We report research on gestural control of digital music, currently performed at the University of California Irvine. Experiments with various motion capture systems are performed, including single video camera systems and a 3D optical motion capture system (Vicon 8). We present a series of demos of various approaches for motion analysis and gesture-to-sound mapping.
متن کاملAn automated time and hand motion analysis based on planar motion capture extended to a virtual environment
In the context of industrial engineering, the predetermined time systems (PTS) play an important role in workplaces because inefficiencies are found in assembly processes that require manual manipulations. In this study, an approach is proposed with the aim to analyze time and motions in a manual process using a capture motion system embedded to a virtual environment. Capture motion system trac...
متن کاملThe influence of respiratory motion on dose distribution of 3D-CRT and IMRT- A simulation study
Background: 3DCRT (three-dimensional conformal radiotherapy) and IMRT (intensity-modulated radiotherapy) has provided us with tools to delineate the radiation dose distribution of tumor targets. However, the precision of radiation can be compromised by respiratory motion, which usually limits the geometric and dosimetric accuracy of radiotherapy. The purpose of this study is to evaluate the imp...
متن کاملاستفاده از برآورد حالتهای پویای دست مبتنی بر مدل، برای تقلید عملکرد بازوی انسان توسط ربات با دادههای کینکت
Pose estimation is a process to identify how a human body and/or individual limbs are configured in a given scene. Hand pose estimation is an important research topic which has a variety of applications in human-computer interaction (HCI) scenarios, such as gesture recognition, animation synthesis and robot control. However, capturing the hand motion is quite a challenging task due to its high ...
متن کاملVirtual dance and music environment using motion capture
We present a multimedia project incorporating music and dance. We used a 3D motion capture system to produce animations from dance and generate the soundtrack from the dancer's movements. Movement analysis is performed to extract the important features of a particular gesture. Based on the parameters chosen from this analysis, various mappings between gesture and music are applied. In particula...
متن کامل